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ESTIMATION OF MEANS IN GRAPHICAL GAUSSIAN MODELS 

WITH SYMMETRIES 

By Helene Gehrmann and Steffen L. Lauritzen 

University of Oxford 

We study the problem of estimability of means in undirected 
graphical Gaussian models with symmetry restrictions represented 
by a colored graph. Following on from previous studies, we parti- 
tion the variables into sets of vertices whose corresponding means 
are restricted to being identical. We find a necessary and sufficient 
condition on the partition to ensure equality between the maximum 
likelihood and least-squares estimators of the mean. 

1. Introduction. The elegant principles of symmetry and invariance ap- 
pear in many areas of statistical research [e.g., Dawid (1988), Diaconis 
(1988), Eaton (1989), Viana (2008)]. Symmetry restrictions in the multi- 
variate Gaussian distribution have a long history [Andersson (1975), Ander- 
sson, Br0ns and Jensen (1983), Jensen (1988), Olkin (1972), Olkin and Press 
(1969), Votaw (1948), Wilks (1946)] and have recently been combined with 
conditional independence relations [Andersen et al. (1995), H0jsgaard and 
Lauritzen (2008), Hylleberg, Jensen and 0rnb0l (1993), Madsen (2000)]. 

This article is concerned with graphical Gaussian models with symmetry 
constraints introduced by H0jsgaard and Lauritzen (2008). The types of 
restrictions are: equality between specified elements of the concentration 
matrix (RCON), equality between specified partial correlations (RCOR) and 
restrictions generated by permutation symmetry (RCOP), a special instance 
of the former two. The models can be represented by vertex and edge colored 
graphs, where parameters associated with equally colored vertices or edges 
are restricted to being identical. 

We consider maximum likelihood estimation of a nonzero mean \x subject 
to specific equality constraints, assuming the covariance matrix £ satis- 
fies the restrictions of one of the above models. This could be relevant, for 
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Fig. 1. Graphical Gaussian symmetry model supported by Frets' s heads. 

example, if treatment effects are to be estimated in an experiment where 
the basic error structure in the units exhibits conditional independencies in 
a symmetric pattern. 

For the Gaussian distribution, maximum likelihood estimation of fj, under 
an unknown covariance structure is generally nontrivial, as the maximizer of 
the likelihood function in \x for fixed E may depend on E. The least-squares 
estimator /i*, however, is defined by minimizing the sum of squares so that 
in case of equality of fi and //*, the former is independent of E. Kruskal 
(1968) showed that for for fixed E, and [i in an affine space O, p, and li* 
agree if and only if Q is stable under E, or equivalently under K = E ; 
see also Haberman (1975) and Eaton (1983). Here we derive a necessary 
and sufficient condition on the graph coloring representing a model and the 
symmetry constraints on the mean vector li which ensures this stability and 
hence equality of estimators. 

We let G = (V, E) denote the dependence graph of the model and let its 
colored version be denoted by Q = (V,£ ), where V denotes a partition of V 
into vertex color classes and £ a partition of E into edge color classes. The 
symbol A4 is to denote a partition of V such that whenever two vertices 
are in the same set of A4, the corresponding means are restricted to being 
equal. The necessary and sufficient condition for equality of \x and li* in 
the symmetry model represented by (V,£) is twofold: (i) the partition M 
must be finer than V; and (ii) the partition must be equitable with respect 
to every edge color class in £ as defined by Sachs (1966). 

For example, the graph in Figure 1 represents a graphical Gaussian sym- 
metry model for data concerning the head dimensions of first and second 
sons known as Frets's heads [Frets (1921), Mardia, Kent and Bibby (1979)]; 
here L±,Bi denotes the length and breadth of the head of the first son, and 
similarly for L2 , -B2 • 

This model has previously been found to be well supported by the data 
[Gehrmann (2011), H0jsgaard and Lauritzen (2008), Whittaker (1990)] when 
no constraints were considered on the means. We may, for example, be in- 
terested in the hypothesis that the two lengths have the same mean, and the 
two breadths have the same mean, indicating that head dimensions do not 
generally change with the parity of the son. We shall demonstrate that this 
hypothesis is simple in the sense that the maximum likelihood estimator, or 
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MLE for short, of the mean under this hypothesis can be found by a simple 
average. Also, we shall demonstrate that this is not the case if we consider 
lengths and breadths separately. 

2. Preliminaries and notation. 

2.1. Graphical Gaussian models. Let G = (V,E) be an undirected graph 
with vertex set V and edge set E and let Y = (Y a ) a& y be a multivariate 
Gaussian random vector. Then the graphical Gaussian model represented 
by G is the set of Gaussian distributions for which Y a is conditionally in- 
dependent of Yp given the remaining variables, denoted Y a JL Yg | Yy\i a n, 
whenever there is no edge between a and (3 in G. 

For a multivariate Gaussian E) distribution with concentration 

matrix S _1 = K = (k a fs) a ,i3ev, it holds that Y a JL Yp \ Y v \i a n if and only 
if k a B = 0. Thus letting S + (G) denote the set of symmetric positive defi- 
nite matrices indexed by V whose a/3-entry is zero whenever a(3 £ E, the 
graphical Gaussian model represented by G assumes 

y ~A/]y|(^,£), fien = M v ,^~ 1 = KeS + {G). 

For further details, see, for example, Lauritzen (1996), Chapter 5. 

2.2. Graph coloring. For general graph terminology we refer to Bollobas 
(1998). Following H0jsgaard and Lauritzen (2008) we define the following 
notation for graph colorings. Let G = (V,E) be an undirected graph. Then 
a vertex coloring of G is a partition V = {Vi, . . . , Vk} of V, where we refer 
to Vi,...,Vk as the vertex color classes. Similarly, an edge coloring of G is 
a partition £ = {E±, ...,£";} of E into I edge color classes E\, . . . ,Ei. We call 
a color class containing one element a singleton and a partition containing 
only singletons as elements a singleton partition. 

Then Q = (V,£) denotes the colored graph with vertex coloring V and 
edge coloring £; we also say that (V,f) is a graph coloring. We indicate 
the color class of a vertex by the number of asterisks we place next to it. 
Similarly we indicate the color class of an edge by dashes, color classes which 
are singletons are displayed in black and without asterisks or dashes. 

2.3. Further notation. As we shall be considering constraints on the 
mean vector defined by partitions of the mean vector into groups of equal 
entries, we introduce the following notation. For A4 a partition of V and 
a,/3 € V, we write a = fi{M) to denote that a and f3 lie in the same set 
in Ai and let f2(.M) be the linear space of vectors which are constant on 
each set of the partition Ai: 

(1) Q(M) = {{x a ) a< z V eR v :x a = x/s whenever a = (3(M)}. 
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For two partitions Mi and M2 of the same set, we shall say that Mi is 
finer than M2, denoted by Mi < M2, if every set in M2 can be expressed 
as a union of sets in Mi- We equivalently say that M2 is coarser than M\. 

If A is a set of edges in a graph G, for a 6 V we shall write ne^a) to 
denote the set of vertices which are connected to a by an edge inside A. 

We further adopt the following notation from H0jsgaard and Lauritzen 
(2008). For a colored graph Q = (V,£) and u G V we let T 1 * denote the 
|V| x |V| diagonal matrix with T^ a = 1 if a £u and otherwise. Similarly, 
for each edge color class u € £ we let T u be the |V| x |V| symmetric matrix 
with T"g = 1 if {a,/?} G u and otherwise. 

3. Maximum likelihood and least-squares estimation. Letting K = E _1 
as above, the density of Y ~ N\y\{n, S) is given by 

det K 1 / 2 

U,x(y) = ^a\v\/2 ex P{~(^ - m) *"(y-A*)/2} 

so that the likelihood function based on a sample 3^ = (X 4 )i<i< n where Y % 
are independent, and Y % ~ jVjyi(jU, S) becomes 



(2) 



LGu,K;y)ocdeti^/ 2 expj- ^ - / i ) T if( ! / i - p)/2] 



If // is unrestricted, so that /i£fi = IR^ 7 , the likelihood function L in (2) 
is maximized over fi for fixed by the least squares estimator fj,* = y, and 
inference about K can be based on the profile likelihood function 

(3) Lifi, K; y) oc det K n/2 exp{- ti(KW) /2}, 

where W = Y^i=\(y % ~ ^*){v l ~ ^*) T ls the matrix of sums of squares and 
products of the residuals. However, inference about (i when K is unknown 
and needs to be estimated is generally not possible, a classic example being 
known as the Behrens-Fisher problem [see Scheffe (1944) and Drton (2008)], 
where S is bivariate and diagonal whereas the mean vector satisfies the 
restriction [i\= [12- 

Kruskal (1968) found the following necessary and sufficient condition for 
the two estimators to agree for fixed S: 

Theorem 1 (Kruskal). Let Y be a random vector in an inner product 
space with unknown mean fi in a linear space £1 and known covariance ma- 
trix E . Then the estimators fi* and ft coincide if and only if is invariant 
under K = X -1 , that is, if and only if 

(4) C n. 

Consequently, if (4) is satisfied by all K in a model, the likelihood function 
can be maximized for fixed K by /i*, and inference on K can be based on 
the profile likelihood (3). 
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4. Model types. 

4.1. Descriptions. As stated earlier, we consider three model types in- 
troduced in H0jsgaard and Lauritzen (2008), which can be represented by 
colored graphs. These are discussed briefly here, and we refer to H0jsgaard 
and Lauritzen (2008) for further details. 

RCON models: Restrictions on concentrations. RCON models place 
equality constraints on the concentration matrix K. They restrict off-diagonal 
elements of K separately from those on the diagonal, so that the restrictions 
can be represented by a graph coloring (V, £) of G, with V representing the 
diagonal and £ the off-diagonal constraints. The corresponding set of posi- 
tive definite matrices is denoted by S + (V,£). 

RCOR models: Restrictions on partial correlations. RCOR models com- 
bine equality restrictions on the diagonal of K with equality constraints on 
partial correlations, given by 

(5) P a p\v\{a,p} = 7== » a,/3£V,a^(3. 

Constraints of RCOR models may also be represented by a graph coloring 
(V, £), and we denote the corresponding set of positive definite matrices by 
TZ+(V,£). 

RCOP models: Permutation symmetry. RCOP models are determined 
by distribution invariance under a group of permutations of the vertices 
which preserve the edges of the graph, that is, a subgroup of Aut(G), the 
group of automorphisms of G. For a € Aut(G), let G{a) be the permutation 
matrix representing a, with G{o~) a p = 1 if and only if a maps f3 to a, for 
a, /3 G V. Then a Gaussian A/jy|(0,£) distribution is preserved by a if and 
only if 

(6) Gia)KG(a)' 1 =K. 

The RCOP model generated by a group V C Aut(G) assumes 

K e S + (G, r) = S + (G) n S + (T) , 

where 5 + (r) denotes the set of positive definite matrices satisfying (6) for 
all a G r [H0jsgaard and Lauritzen (2008)]. 

4.2. Relations between model types. Under certain conditions on the col- 
oring, RCON and RCOR models, which are determined by the same colored 
graph, coincide in their model restrictions. First we define edge regularity 
of a graph coloring. 
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Definition 1. Let Q = (V,£) be a colored graph. We say that (V,£) is 
edge regular if any pair of edges in the same color class in £ connects the 
same vertex color classes. 

The relevant result in H0jsgaard and Lauritzen (2008) then becomes: 

Proposition 1. The RCON and RCOR models, that are determined by 
the colored graph Q = (V,£), yield identical restrictions, that is, 

S + (V,£)=TZ + (V,£) 

if and only if (V, £) is edge regular. 

RCOP models fall into the class of models which satisfy the condition in 
Proposition 1, as we show below: 

Proposition 2. If a colored graph Q = (V,£) represents an RCOP 
model, then (V,£) is edge regular. 

Proof. Let Q = (V, £) represent an RCOP model, generated by permu- 
tation group r C Aut(G), say, and let u G £ and e, / G u. By definition, there 
exists a G T mapping e to / while leaving (V,£) invariant. This implies that 
the colorings of the end vertices of e and / must be identical. □ 

Thus, if for a graph G = (V, E) we let V and £ denote the vertex orbits and 
edge orbits of a group V C Aut(G), then S+(G,T) = S+(V,£) = K + (V,£) 
[H0jsgaard and Lauritzen (2008)]. 

For example, since the coloring of the graph in Figure 1 is generated by 
the group T = {I, a} with a simultaneously permuting B\ with B2 and L\ 
with L2, the corresponding two sets S + (V,£) and TZ + (V,£) coincide. 

5. Equality of maximum likelihood and least-squares estimator. By The- 
orem 1, the maximum likelihood estimator fx and least-squares estimator \i* 
agree for \i in a linear subspace O C M. v if and only if $7 is stable under all K 
in the model. Below we show that for RCON and RCOR models, and thus 
also for RCOP models, invariance of Vl under K is equivalent to invariance 
under {T u } ueVu£ . 

Proposition 3. Let Q = (V, £) be a colored graph representing the RCON 
model with K G S + {V,£). Then for C MX , 

KttQQ VA'gS + (V,£) T U QCQ VuGVu£. 

Proof. By definition of RCON models, all K G 5 + (V, £) can be written 

as 

(7) K= Yl 6uTU ' flnGKfor -uGVU£ 

u6VU£ 
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with {# u }ueVu£ such that the expression in (7) is positive definite. Suppose 
first that we have 

T U {}QQ VuGVU£. 

Since f2 is a linear space this implies invariance under all K G S + (V,£ ). 

Next suppose KQ C Q for all K G S + (V,£). <S + (V, £) is an open convex 
cone, so that for all K G <S + (V,£) and u G V U £ there exists A tt 6l \ {0} 
such that 

K u = if + A u T u ecS + (V,£). 
By assumption, KQ C O and -ftT^O C 0, which gives 

(# w - k)q = x u T u n c n 

and thus the desired result. □ 

Although the cone 1Z + (V,£) is not in general convex, the same holds for 
RCOR models, as shown below. 

PROPOSITION 4. Let Q = (V,£) be a colored graph. Then for SI C R v , 
KQCQ MK £K + (V,£) rncfi VuGVu£. 

Proof. Let A = (a a p) at p£v denote the diagonal matrix with entries 
equal to the inverse partial standard deviations, that is, 

O-aa = \/ k a a for a G V, 

and let C = (c a ^) a ^^y have all diagonal entries equal to 1 and all off- 
diagonal entries be given by the negative partial correlations — p a p\v\{a,p}- 
Then, by (5), all K G 1Z + (V,£) can be uniquely expressed as 

(8) K = ACA= a v a w T v T w + ^ c u a v a w T v T u T w , 

v,w£V v,wGV,u££ 

where for v G V and u G £, we let a v and c u denote a aa , a G v and c a p, 
a/3 G u, respectively. As for v,w G V, T V T W is zero unless v = w, when it 
equals T°, and equation (8) simplifies to 

(9) K = Y J <%r V + E c u a v a w T v T u T w . 

Suppose first that we have 

T U Q QQ Vu G V U £. 

As before, since is a linear space, (9) implies invariance under all K G 
7Z + (V,£ ). So suppose K£l C fi for all K G 1Z + (V,£). Then, in particular, Q 
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is invariant under all K of the form 

K = AC A with A = a 2 1 and C as specified above, 

represented by the graph coloring ({^}, £), which has the same edge coloring 
as (V, £), but with all vertices of the same color. This graph coloring is 
clearly edge regular (as all edges connect the only vertex color class back to 
itself), which gives that the represented model is also of type RCON. We 
may therefore apply Proposition 3, giving 

T u n C tt Vu G £. 

For the vertex coloring, consider the submodel 

K = AC A with A as specified above and C = I. 

This submodel is represented by the independence graph with no edges and 
vertex coloring V, which is also edge regular, so that by Proposition 3, 

T v tt QQ Vv G V, 

completing the proof. □ 

5.1. Equality restrictions in the means of RCON and RCOR models. 
Let Ai be a partition of V and consider Q(7W) as in (1). In the following 
we derive a necessary and sufficient condition on Ai and (V,£) for fl(Ai) to 
be invariant under all K G S + (V,£ ) or all K G 1Z + (V,£). By Propositions 3 
and 4 we may consider vertex and edge color classes of the colored graph 
representing the model separately. We begin with the vertex coloring. 

Proposition 5. Let M and V be partitions of V . Then Q(M) is in- 
variant under {T v } v ^\; if and only if Ai < V. 

Proof. The action of T v for v € V on ji G MX is given as 

T v = | H a if a G v, 

1 otherwise. 

Let n G tt(M), and suppose that T V Q,(M) C Q.(M) for all v G V. In order for 
T v n G for all v G V, we must have a = /3(V) whenever a = f3(M), or 

equivalently M. < V. Conversely, suppose Ai <V. Then a = /3(V) whenever 
a = P(M), which gives T> G n(M) for all veV. □ 

Note that the above result implies that the likelihood cannot be max- 
imized in fi independently of the value of K in the Behrens-Fisher set- 
ting, which is the RCON and RCOR model on two variables specified by 
V = {{1}, {2}}, £ = together with the restriction fj,\ = (j,2 on the means, 
as the mean partitioning is then coarser than the vertex coloring. 
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Also, for the model of Frets's heads in Figure 1, the MLE of the mean is 
not simple if we, for example, wish to estimate the mean under the hypoth- 
esis that the heads tend to be square-shaped, that is, if mean lengths are 
equal to mean breadths, as this partition would not be finer than the vertex 
coloring. 

For the edge coloring, we require the concept of an equitable partition, 
first defined by Sachs (1966). 

Definition 2 (Sachs). Let G= (V,E) be an undirected graph. Then 
a partition, or equivalent coloring, V of V is called equitable with respect 
to G if for all v 6 V, a,/3 £ v, 

| ne£;(a) n w\ = | ne^(/3) n w | Vu> G V. 
Chan and Godsil (1997) proved the following. 

Proposition 6 (Chan and Godsil). Let G = (V,E) be an undirected 
graph with adjacency matrix T, and let M be a partition ofV. Then Q(M) 
is invariant under T if and only if M is equitable with respect to G. 

The notion of an equitable partition for vertex colored graphs can be 
naturally extended to graphs with colored vertices and edges. We term the 
corresponding graph colorings vertex regular, defined below. 

Definition 3. Let Q = (V, £) be a colored graph, and let the subgraph 
induced by the edge color class u £ £ be denoted by G u = (V, u). We say that 
(V,£) is vertex regular if V is equitable with respect to G u for all u G £. 

Combining Definition 3 with Proposition 6 yields vertex regularity to be 
a necessary and sufficient condition for Q(A4) to be invariant under {T u } u£ £-. 

Proposition 7. For Q = (V,£) a colored graph and M a partition ofV, 
Q(M) is invariant under {T u } ug £ if and only if (A4,£) is vertex regular. 

Proof. For uE£, T u is the adjacency matrix of G u . By Proposition 6, 
£l(M) is stable under {T u } u& £ if and only if A4 is equitable with respect to 
G u for all u G £, or equivalently if and only if (A4,£) is vertex regular. □ 

For the Frets's heads model in Figure 1, this implies that restricting 
the mean breadths and mean lengths on their own does not ensure fi = 
fj,*, as the corresponding partitions M. = {{-Bi, -B2}, {-ki}> {-^2}} and M = 
{{B\}, {B2}, {Li,L2}} do not give rise to vertex regular colorings (Ai,£). 

Combining Proposition 5 and Proposition 7 establishes our main result: 

Theorem 2. Let Q = (V,£) be a colored graph, let A4 be a partition ofV 
and consider a sample from a multivariate Gaussian A/|^|(/x, S) distribution 
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with [x € tt(M) and K = S" 1 € S + (V,£), both unknown. It then holds that 
(10) fi = fj,* <^=^> M. < V and (M,£) is vertex regular. 
The same conclusion holds if S + (V,£) is replaced by 1Z + (V,£). 

In fact, for any colored graph Q = (V, £) there is always a coarsest parti- 
tion A4 satisfying the conditions in (10) [Gehrmann (2011)]. The finest vari- 
ant of such a coarsest equitable refinement A4 of V is given by the singleton 
partition. Clearly it is finer than any vertex coloring, and further naturally 
gives a vertex regular coloring (A4,£). Note that in this case Cl(Ai) corre- 
sponds to the unrestricted case considered in Section 3, conforming with the 
fact that then \x = fx*. 

5.2. Equality restrictions in the means in RCOP models. The coarsest 
possible M for RCON and RCOR models, by (10), is V, for which /} = //* 
if and only if (V,£) is vertex regular. This always holds for RCOP models. 

Proposition 8. // a colored graph Q = (V,£) represents an RCOP 
model, then (V, £) is vertex regular. 

Proof. Let Q = (V,£) represent an RCOP model, generated by a sub- 
group T C Aut(G), say. By Proposition 2, (V, £) is edge regular. Thus when- 
ever two edges e, / € E are of the same color, they connect the same vertex 
color classes. Let a,f3&V be two equally colored vertices in V. Then, by 
definition of RCOP models, there exists a permutation a £ T which maps a 
to (3 leaving (V,£) invariant. This implies that the degree in each edge color 
class of a and f3 must be identical. The previous two statements imply 

| ne n (a) PI v\ = \ ne u ([3) n v \ 

for all !)£V and all pairs a,/3 S V with a = /3(V), which is precisely the 
criterion of vertex regularity for the graph coloring (V,£). □ 

We mention in passing that Proposition 2 and Proposition 8 combined 
establish that colorings of graphs which represent RCOP models are regular 
in the terminology of Siemons (1983). We conclude from Theorem 2 and 
Proposition 8: 

Corollary 1. Let G = (V,E) be an undirected graph, and let (V,£) 
represent the constraints of an RCOP model generated by group T C Aut(G). 
Then for a sample from a multivariate Gaussian N\v\ (a 1 ! ^) distribution with 
/i G O(V) and K = X" 1 € S + (G,T), both unknown, we always have fi = fi* . 

6. Examples. We first consider the example in Figure 1 on head dimen- 
sions for first and second sons. Representing an RCOP model, by Proposi- 
tion 8, the graph in Figure 1 has a vertex regular coloring. It follows from 
Corollary 1 that the maximum likelihood estimate of the mean under the 
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hypothesis that the mean length and mean breadth are equal for the two 
sons is simply the total average of the head lengths and the head breadths, 
respectively. Similarly, it follows from Theorem 2 that the only hypotheses 
about the mean that have a simple solution are this one and the one where 
the means are completely unrestricted. 

The empirical means of the dimensions (Bi,E>2, L\,L<i) are equal to (151.12, 
149.24, 185.72, 183.84), so that the MLE of the means under the hypothesis 
that the mean lengths and breadths are independent of the parity of the 
son then become (150.18,150.18,184.78,184.78). The likelihood ratio test 
is obtained by comparing the maximized profile likelihoods (3) calculated 
with appropriate residual covariance matrices W under the two hypothe- 
ses. Using the R-package gRc [H0jsgaard and Lauritzen (2011)] this yields 
— 21ogLR = 3.27 on 2 degrees of freedom, so there is no evidence for the 
sizes depending on the parity of the son. 

Our second example is concerned with the examination marks of 88 stu- 
dents in five mathematical subjects [Mardia, Kent and Bibby (1979)]. The 
RCOP model represented by Q = (V, £) in Figure 2 was demonstrated to be 
an excellent fit in H0jsgaard and Lauritzen (2008). 

The model is given by invariance of K under simultaneously permuting 
Mechanics with Statistics, and Vectors with Analysis. In their fit, Hojsgaard 
and Lauritzen (2008) implicitly assumed an unconstrained mean. The MLE ft 
is then given by the sample averages (/t a i, /t an , jl me , /} s t, /t ve ) = (50.60,46.68, 
38.96,42.31,50.59) in the obvious notation, which corresponds to A4 being 
the singleton partition. However, it could be natural to assume /i subject to 
the same invariance as K, meaning M. = V, or in this case /u an — f^he and 
Ai mc =Het- Then, by Corollary 1, (/2 al) /i an , ft mc , /t st , /t vc ) = (50.60,48.64,40.63, 
40.63,48.64). The likelihood ratio statistic for this mean structure relative 
to the model in Figure 2 with unconstrained mean takes the value of 11.9 
on 2 degrees of freedom, and the hypothesis about symmetry in the means 
is therefore clearly rejected with p < 0.003. 

Note that the sample averages for Vectors and Algebra are almost iden- 
tical. However, combining the constraints on K represented by the graph in 
Figure 2 with any hypothesis on the means implying fx ve = p, & \ will require 
joint maximization in /i and K of the likelihood function in (2) to obtain ft. 
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7. Discussion. The main result of this article is a necessary and sufficient 
condition on the pattern of equality constraints on the mean vector \i in 
a graphical Gaussian symmetry model with colored graph Q = (V,£) which 
ensures the identity of the least squares estimate (i* and the maximum 
likelihood estimate ft, given in Theorem 2. 

The derived necessary and sufficient condition is formulated in terms of 
vertex and edge colored graphs and is easily testable, so that any set of 
equality constraints on together with constraints on either K or the partial 
correlations can be verified for estimability of /U by /i*. 

The result is, for example, useful if one set of constraints, either on the 
mean or the independence structure, is assumed to be given and the other 
may be varied. A setting which falls into this category is the design of ex- 
periments seeking to estimate mean treatment effects under the assumption 
of correlations with inherent symmetries in the error structure at experi- 
mental sites. A systematic arrangement of the sites may enforce a symme- 
try pattern in the concentrations or partial correlations, and thus restrict 
the concentration matrix as in one of models considered here. Allocation 
of treatments then effectively restricts the mean response at sites with the 
same treatment to be identical, and the condition derived can be used to 
find treatment allocations which ensure estimability of mean treatment ef- 
fects without knowledge of the value of E. 

An interesting question directly emerging from our work is concerned 
with the exact distributions of likelihood ratio test statistics for hypothe- 
ses about the mean in RCON, RCOR and RCOP models. In the examples 
discussed in this paper we have relied on asymptotic theory to judge the 
significance of test statistics, but it is likely that their distributions can be 
derived explicitly, for example when the mean hypothesis is given by the 
natural symmetry of an RCOP model. Hylleberg, Jensen and 0rnb0l (1993) 
developed explicit likelihood ratio tests for decomposable mean-zero RCOP 
models generated by compound symmetry [Votaw (1948)], and it would be 
interesting to extend these results to models with nonzero means and more 
general symmetry constraints. 

We note that if our condition is not satisfied, we would expect phenom- 
ena similar to those in the Behrens-Fisher problem implying the general 
nonuniqueness of the MLE [Drton (2008)] and the nonexistence of an a- 
similar test of the mean hypothesis [Scheffe (1944)]. 
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